Papers with structured data
Findings of the Third Workshop on Neural Generation and Translation (D19-56)
Copied to clipboard
Hiroaki Hayashi, Yusuke Oda, Alexandra Birch, Ioannis Konstas, Andrew Finch, Minh-Thang Luong, Graham Neubig, Katsuhito Sudoh
| Challenge: | The 3rd Workshop on Neural Machine Translation and Generation (WNGT) was held in concert with the annual conference of the Empirical Methods in Natural Language Processing (EMNLP 2019). |
| Approach: | They describe the results of the third workshop on Neural Generation and Translation held in concert with the annual conference of the Empirical Methods in Natural Language Processing (EMNLP 2019). |
| Outcome: | The results of the 3rd Workshop on Neural Machine Translation and Generation (WNGT) were summarized in Sections 3 and 4. |
DART: A Lightweight Quality-Suggestive Data-to-Text Annotation Tool (2020.coling-demos)
Copied to clipboard
| Challenge: | Neural data-to-text generation systems require large-scale labeled data to generate sentences. |
| Approach: | They propose to create an interactive annotation tool that iteratively analyzes annotated structured data to better sample unlabeled data. |
| Outcome: | The proposed tool reduces the number of annotations needed with active learning and automatically suggests relevant labels. |
Data2Text Studio: Automated Text Generation from Structured Data (D18-2)
Copied to clipboard
| Challenge: | Data2Text Studio is a platform for automated text generation from structured data. |
| Approach: | They conduct experiments on RotoWire datasets for template extraction and text generation . they find that the Semi-HMMs model improves interactivity and interpretability . |
| Outcome: | The proposed model improves on template extraction and text generation tasks on RotoWire datasets. |
Recognizing Multimodal Entailment (2021.acl-tutorials)
Copied to clipboard
Cesar Ilharco, Afsaneh Shirazi, Arjun Gopalan, Arsha Nagrani, Blaz Bratanic, Chris Bregler, Christina Funk, Felipe Ferreira, Gabriel Barcik, Gabriel Ilharco, Georg Osang, Jannis Bulian, Jared Frank, Lucas Smaira, Qin Cao, Ricardo Marino, Roma Patel, Thomas Leung, Vaiva Imbrasaite
| Challenge: | This tutorial introduces the multimodal entailment task for detecting semantic alignments . the task requires fine-grained understanding of visual and linguistic semantics questions . |
| Approach: | This tutorial introduces the multimodal entailment task to machine learning . it introduces a dataset for recognizing multimodal alignments . |
| Outcome: | This tutorial introduces the multimodal entailment task . it can be useful for detecting semantic alignments when a single modality alone is not enough . |
StrucText-Eval: Evaluating Large Language Model’s Reasoning Ability in Structure-Rich Text (2025.acl-long)
Copied to clipboard
| Challenge: | Structured data has been central to corporate data strategies for decades . however, with the advancement of large language models (LLMs), there has been a significant shift towards the effective utilization of unstructured data. |
| Approach: | They propose an automatic evaluation data generation method to assess LLMs’ reasoning capabilities on structure-rich text. |
| Outcome: | The proposed method supports 8 structured languages and 29 tasks, generating data with adjustable complexity through controllable nesting and structural width. |
Selecting, Planning, and Rewriting: A Modular Approach for Data-to-Document Generation and Translation (D19-56)
Copied to clipboard
| Challenge: | Existing systems for document-level generation and translation are too complex to capture the complexity of the problem. |
| Approach: | They propose to adapt a large scale system trained on WMT data to a document in a different language. |
| Outcome: | The proposed system generates a textual document from structured data or a document in a different language. |
Implementing Retrieval Augmented Generation Technique on Unstructured and Structured Data Sources in a Call Center of a Large Financial Institution (2025.naacl-industry)
Copied to clipboard
Syed Shariyar Murtaza, Yifan Nie, Elias Avan, Utkarsh Soni, Wanyu Liao, Adam Carnegie, Cyril John Mathias, Junlin Jiang, Eugene Wen
| Challenge: | generative AI models can extract accurate facts from external unstructureddata sources. |
| Approach: | They propose to use data embeddings to enhance RAG for retrieving facts from structured data sources, achieving low latency and high reliability. |
| Outcome: | The proposed model achieves low latency and high reliability and average response time of 7.33 seconds. |
A Multi-Agent Framework for Quantitative Finance : An Application to Portfolio Management Analytics (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have opened up promising new avenues by enhancing reasoning and inference capabilities across diverse data and information sources. |
| Approach: | They propose a multi-agent framework that facilitates mathematical modeling and data analytics by dynamically generating executable code. |
| Outcome: | The proposed framework outperforms existing models on portfolio management tasks and provides human-readable explanations for its predictions. |
Does the Order of Training Samples Matter? Improving Neural Data-to-Text Generation with Curriculum Learning (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent advances in data-to-text generation have been focused on curriculum learning, which is a process of presenting training data in a specific order, starting from easy examples and moving on to more difficult ones, as the learner becomes more competent. |
| Approach: | They propose to use a curriculum learning process to change the order of training samples in a model based on the model's competence to improve model performance and convergence speed. |
| Outcome: | The proposed model shows faster convergence speed and reduced training time by 38.7% and performance by 4.84 BLEU. |
An Integrated Formal Representation for Terminological and Lexical Data included in Classification Schemes (L18-1)
Copied to clipboard
| Challenge: | e-lexicography is a field of study dealing with the automated creation of specialized multilingual dictionaries from structured data. |
| Approach: | They propose to use a SKOS-XL vocabulary for modelling the multilingual terminological part of comparable taxonomies and OntoLex-Lemon for modelling multilingual lexical entries. |
| Outcome: | The proposed model can be explicitly cross-linked in the context of the Linguistic Linked Open Data (LLOD). |
LLaSA: Large Language and Structured Data Assistant (2025.naacl-long)
Copied to clipboard
Yao Xu, Shizhu He, Jiabei Chen, ZengXiangrong ZengXiangrong, Bingning Wang, Guang Liu, Jun Zhao, Kang Liu
| Challenge: | Structured knowledge grounding (SKG) tasks are a key part of many NLP applications. |
| Approach: | They propose a framework for enhancing LLMs' ability to handle structured data . they represent various types of structured data in a unified hypergraph format . |
| Outcome: | The proposed framework outperforms existing methods on SKG tasks using LoRA finetuning. |
TWT: Table with Written Text for Controlled Data-to-Text Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods output hallucinated text that is not faithful on TWT. |
| Approach: | They propose to generate text conditioned on the structured data and a prefix by leveraging pre-trained neural models. |
| Outcome: | The proposed approach outperforms state-of-the-art methods under automatic and human evaluation metrics. |
How Much Pretraining Does Structured Data Need? (2026.eacl-long)
Copied to clipboard
| Challenge: | Large language models are increasingly adopted for handling structured data, despite pretraining on unstructured text. |
| Approach: | They propose to re-initialize subsets of layers with random weights before fine-tuning on structured datasets. |
| Outcome: | The proposed models are compared to unstructured datasets and show that they perform well over structured data. |
Faithful Low-Resource Data-to-Text Generation through Cycle Training (2023.acl-long)
Copied to clipboard
| Challenge: | Methods to generate text from structured data have advanced significantly in recent years, but can fail to produce output faithful to the input data, especially on out-of-domain data. |
| Approach: | They evaluate the effectiveness of cycle training by using two models which are inverses of each other to generate text from structured data and one which generates the structured data from natural language text. |
| Outcome: | The proposed approach achieves nearly the same performance as fully supervised approaches on the WebNLG, E2E, WTQ, and WSQL datasets. |
Multilingual AMR-to-Text Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on generating text from structured data into English has focused on bridging the gap between structure and natural language (NL) and semantically underspecified input and fully specified output. |
| Approach: | They propose a multilingual approach that can decode into 21 different languages . they leverage advances in cross-lingual embeddings and pretraining to generate multilingual models . |
| Outcome: | The proposed model surpasses baselines that generate into one language in eighteen languages. |
PyRATA, Python Rule-based feAture sTructure Analysis (L18-1)
Copied to clipboard
| Challenge: | a new Python module supports rules-based analysis on structured data . the module is available under the Apache V2 license . |
| Approach: | They propose a Python module which supports rules-based analysis on structured data. |
| Outcome: | The proposed module supports rules-based analysis on structured data. |
Deep Inductive Logic Reasoning for Multi-Hop Reading Comprehension (2022.acl-long)
Copied to clipboard
| Challenge: | a new method for multi-hop reading comprehension uses deep learning to reason across documents . a previous study showed that deep learning methods only implicitly encode query-related information into embeddings . |
| Approach: | They propose a deep-learning based inductive logic reasoning method that extracts query-related information and conducts logic reasoning among filtered information. |
| Outcome: | The proposed model is evaluated on two reading comprehension datasets . it uses attentive memories with novel differentiable logic operators . |
Private prediction for large-scale synthetic text generation (2024.findings-emnlp)
Copied to clipboard
Kareem Amin, Alex Bie, Weiwei Kong, Alexey Kurakin, Natalia Ponomareva, Umar Syed, Andreas Terzis, Sergei Vassilvitskii
| Challenge: | Existing approaches to generate differentially private text using large language models are classified into several categories. |
| Approach: | They propose a private prediction framework that generates differentially private synthetic text using large language models via private prediction. |
| Outcome: | The proposed approach generates high-quality synthetic data points at reasonable privacy levels while protecting the privacy of users who contributed to the dataset. |
StructGPT: A General Framework for Large Language Model to Reason over Structured Data (2023.emnlp-main)
Copied to clipboard
| Challenge: | Experiments conducted on three types of structured data show that StructGPT greatly improves the performance of LLMs. |
| Approach: | They propose an iterative Reading-then-Reasoning framework to solve question answering tasks based on structured data. |
| Outcome: | The proposed framework improves the reasoning ability of large language models over structured data under the few-shot and zero-shot settings. |